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1. Mixing vs. weak dependence 



For a long time mixing conditions have been the dominating type of condi- 
tions for imposing a restriction on the dependence between time series data. 
Such conditions were introduced at the end of the fifties by Rosenblatt (1956) 
and by the Saint Petersburg school, due to Ibragimov (1962). The notion was 
mainly used in a systematic way by statisticians since this notion fits quite well 
with nonparametric techniques; see for example Rosenblatt (1985) for details. 
The monograph edited by Eberlein and Tacjciu (1986) describes the state of the 
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art at that time, perhaps with the omission of some Russian and French au- 
thors. Doukhan and Portal (1987) obtained strong convergence results for the 
empirical process. Many examples of mixing processes are discussed in Dcjukhan 
(1994) and this monograph also includes previous results by Doukhan, Leon and 
Portal (see the citations included). Furthermore, Dehling and Philipp (2002) 
related several anterior work concerned with the strong invariance principle. 
However, the greatest advance in the theory occured after Rio (1993)'s work; 
his covariance inequality yields indeed sharp central limit results, see for this 
the monograph by Rio (2000) as well as Doukhan, Massart and Rio (1994). We 
would like to mention also contributions by Shao (1988) (who obtained sharp 
results under p-mixing), Shao and Yu (1996) (improved on the empirical CLTs) 
and Mcrlcvcdc and Pcligrad (2002) who tightened and precised several of the 
previous results involved with the strong coupling conditions. A summary of the 
state of the art is given in the very recent monograph by Bradley (2007); see 
also the nice review paper, Bradley (2005). 

On the other hand, it turns out that certain classes of processes which are of 
interest in statistics are not mixing although a successive decline of the influence 
of past states takes place; see for example Dcdccker et al. (2007). The simplest 
example of such a process is an AR(l)-process, Xt = 9Xt-i + et, where the 
innovations are independent and identically distributed with P(et = 1) = f{et = 
-1) = 1/2 and < l^] < 1/2; see also Rosenblatt (1980). It is clear that this 
process has a stationary distribution supported on [—2,2], and for a process 
in the stationary regime, it can be seen from the equality Xt = £t + Ost-i + 
• • • + 9*~''~^£s+i + O^^^Xs that a past state Xs can always be recovered from 
Xt. (Actually, since \et\ > \0\\et-^i\ + ■■■ + |6'|*-'*"i|£,+i| + \e\*-'\X,\ it follows 
that Xt has always the same sign as et which means that we can recover St 
and therefore Xt-i from Xt- Continuing in this way we can finally compute 
Xg.) This, however, excludes any of the commonly used mixing properties to 
hold. On the other hand, Xg loses its impact on Xt as t oo. Another simple 
example of a non-mixing process is the Gallon- Watson model with immigration; 
see Dcdccker et al. (2007). 

Besides the somehow artificial example above, there are many other processes 
of this type which are of great interest in statistics. For example, for bootstrap- 
ping a linear autoregressive process of finite order, it is most natural to estimate 
first the distribution of the innovations by the empirical distribution of the (pos- 
sibly re-centered) residuals and to generate then a bootstrap process iteratively 
by drawing independent bootstrap innovations from this distribution. Now it 
turns out that commonly used techniques to prove mixing for autoregressive 
processes fail; because of the discreteness of the bootstrap innovations it is in 
general impossible to construct a coupling of two processes with different initial 
values. 

Inspired by such problems, Doukhan and Louhichi (1999) and 
Bickel and Biihlmann (1999) introduced alternative notions called weak depen- 
dence and z^-mixing, respectively. Actually, these two concepts are similar; in- 
stead of considering all bounded test functions (as for mixing) they proposed to 
weaken the condition by considering regular functions only which then includes 



p. Doukhan and M.H. Neumann/ili-weak dependence 



148 



many processes which are not mixing. Borovkova, Burton and Dehhng (2001) is 
also an interesting advance in this area, those authors deal with functions of mix- 
ing sequences. A slightly simplified version of Doukhan and Louhichi (1999)'s 
definition is given here: 

Definition 1.1. A process {Xt)t& is called -if) -weakly dependent if there exists 
a universal null sequence (e(r))rGN such that, for any fc-tuple (si, . . . , Sk) and 
any Z-tuple (ti, . . . , ti) with si < ■ ■ ■ < Sk < + r ~ ti < ■ ■ ■ < ti and arbitrary 
measurable functions g : R'^ ^ M, /i : ^ E with |lg||oo < 1 and \\h\\ao < 1, 
the following inequality is fulfilled: 

|cov(5(X,,,...,X,J,/i(Xt,,...,XtJ)| < 7^(fc,Z,Lipg,Lip/i)e(r). 

Here Lip h denotes the Lipschitz modulus of continuity of h, that is, 

Uph = snp^ 

where ||(2;i, . . . ,zi)\\i^ = J2i and -0 : x [0, oo) is an appropriate 

function. 

Remark 1. 

(i) In Bickel and Biihlmann (1999), another type of weak dependence, called 
z/-mixing, was introduced. Similarly to Definition 1.1, uniform covariance 
bounds over classes of functions with smooth averaged modulus of con- 
tinuity are required. Usually, examples of processes obey both notions of 
weak dependence. We think that it is sometimes easier to verify a con- 
dition of weak dependence as in Definition 1.1 which we prefer for this 
reason. 

(ii) Dedecker and Pricur (2005) introduced another related notion, called if- 
weak dependence, which is particularly adapted to expanding dynamical 
systems. 

(iii) For the special case of causal Bernoulli shifts with i.i.d. innovations, that is 
Xt = g{et,£t-i, ■ ■ ■), Wu (200">) introduced other measures of dependence 
which are somewhat connected to the coupling idea below. The notion of 
weak dependence considered here is more general and seems also to include 
processes which cannot be represented as Bernoulli shifts {e.g. associated 
processes perhaps cannot be written as Bernoulli shifts). 

Remark 2. (Some classes of weak dependence) 

Specific functions tp yield variants of weak dependence appropriate to describe 
various examples of models: 

• K-weak dependence for which 'ijj{u,v, a,b) ~ uvab; in this case we simply 
denote e(r) as K(r). 

• k' (causal) weak dependence for which ■ip(u.,v,a,b) = vab; in this case we 
denote e(r) as K'(r). This is the causal counterpart of k coefficients which 
we recall only for completeness. 
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• 77- weak dependence, ^{u, v, a, b) = ua+vb; in this case we write e(r) = ri{r) 
for brevity. 

• 6'-weak dependence is a causal dependence which refers to ip{u,v,a,b) = 
vb; we write e(r) = 9{r) (Dedcckcr and Doukhan (2003)) for this causal 
counterpart of rj coefficients. 

• A-weak dependence ip(u,v,a,b) = uvab + ua + vb; in this case we write 
e(r) = A(r) (Doukhan and Wintenbcrgcr (2007)). Besides the fact that it 
includes ry- and K-weak dependence, this new notion of A-weak dependence 
is convenient, for example, for Bernoulli shifts with associated inputs. 

It turns out that the notion of weak dependence is more general than mixing 
and allows to treat, for example, also Markovian processes driven by discrete 
innovations as they appear with time series bootstrap. In the next section we 
consider as an instructive example linear autoregressive processes of finite order 
and a corresponding bootstrap version thereof. We will demonstrate that the 
desired property of weak dependence readily follows from a contraction property 
which is typical for such models under standard conditions on the parameters. 
The approach described there is also applicable to proving weak dependence for 
many other classes of processes. Section 3 contains further examples of processes 
for which some sort of weak dependence has been proved. In Section 4 we give 
an overview of available tools under weak dependence. In particular, we pro- 
vide a Donsker invariance principle and asymptotics for the empirical process. 
Furthermore, we also give Lindeberg Feller central limit theorems for triangular 
arrays. Finally, we provide probability and moment inequalities of Rosenthal 
and Bernstein type. Proofs of the new results in Section 2 are deferred to a final 
Section 5. 



2. Autoregressive processes and their bootstrap analogues 

In this section we intend to give a brief introduction to the basic ideas commonly 
used for verifying weak dependence. Most parts in this section are specialized 
to autoregressive processes of finite order and their bootstrap analogues. 

We consider first a general real- valued stationary process {Xt)t£Z- A simple 
and in many cases the most promising way of proving a property of weak de- 
pendence is via contraction arguments. For probability distributions P and Q 
on {W^,B'^) with finite mean, we define the metric 

d{P,Q) = inf E\\X~Y\\i„ 

{X.Y):X~P,Y^Q 

For d ~ \ and the L2 instead of the Li distance, we obtain Mallows dis- 
tance; see Mallows (1972). It is well known that such distances are suitable 
for metrizing weak convergence, that is, d(P„,P) — *■ implies P„ =^ P; see 

n — >oo 

e.g. Bickel and Frecdman (1981). Similar distances have also been used in the 
context of Markov processes to derive convergence of stationary distributions 
from convergence of the conditional distributions; see e.g. Dobrushin (1970) and 
Neumann and Paparoditis (2007). The following lemma shows that closeness of 
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the conditional distributions in the above metric gives rise to estimates for co- 
variances. 

Lemma 2.1. Suppose that {Xt)tez is o, real-valued stationary process. Fur- 
thermore, let si < ■ ■ ■ < Sk < ti < ■ ■ ■ < ti be arbitrary and let g : SJ' — > M and 
h : M.^ —> R be measurable functions. Let {X'f.)t£z be any other version of the pro- 
cess, where X'g^ = (X'^^, X'^^_i, . . .) is independent o/ X^j, = (X^^ , . . .). 
If g is bounded and E,\h(Xt-^, . . . , XtJ\ < oo, then 

\cov{g(Xs„...,Xs,),h{Xt„...,Xt,))\ 

< llglloo Lip /i Erf(P^'i l^^*. , P-^'i l^^fc ) . 

This lemma shows that a property of weak dependence follows from a con- 
vergence of the conditional distributions as the time gap to the lagged variables 
tends to infinity. The latter property can often be shown by appropriate cou- 
pling arguments. To get reasonably tight bounds for the covariances, one has to 
construct versions of the process, {Xt)tez and where the 'sfc-histories' 

Xg^ and X^^ are independent but where the corresponding next process values 
Xt and X^ are close; see the example below. Note that there is a close connec- 
tion to the notion of r-dependence introduced by Dcdcckcr and Pricur (2004). 
According to their Lemma 5, the infimum of Ed(P"^* 1^" , P-^tl^^ ) is actually equal 
to their coefficient r(< — s). Dcdecker and Prieur (2004) used such coupling ar- 
guments to derive exponential inequalities and other interesting results, with 
applications to density estimation. 

In the rest of this section we restrict our attention to a real-valued autore- 
gressive process {Xt)tez, which obeys the equation 

Xt = OiXt-i + ■■■ + OpXt-p + et, tG Z. (2.1) 

The innovations {et)t<£Z sue assumed to be independent and identically dis- 
tributed with E^t = 0. Furthermore, we make the standard assumption that the 
characteristic polynomial 6{z) = 1 — 9iz — ■ ■ ■ — 9pZ^ has no zero in the imit 
circle. It is well known that there exists then a stationary solution to the model 
equation (2.1). We will assume that the process {Xt)t£Z is in the stationary 
regime. Then this process can be represented as a causal linear process, 

oo 

Xt = ^UkSt-k, (2.2) 

fc=0 

where au = Y.j<k J2ki+-+kj=k ^'fei ' ' ' ^fc, • Denote by ^i, . . . , the roots of the 
characteristic polynomial 9 and let p = min{|^i|, . . . , |^p|}. Then, for any e > 0, 
there exists a K,, < oo such that, with = (l + e)/p, 

lafcl < Vfc e N; (2.3) 

see e.g. Brockwell and Davis (1991, p. 85). 
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Convergence of Ed(P-^'i '—-^''i , P-^'''i '■■■'^'i ) as - Sfc ^ oo can now 
be shown by a simple coupling argument. For this purpose, we consider a sec- 
ond (stationary) version of the autorcgrcssivc process, {X[)t£z, where X(. is 
independent of X^^.. Note that (Xj)tgz can also be written as a linear process, 

oo 
k=0 

Independence of X(,^ and X^^ is equivalent to the fact that Es^, Ss^-i, ■ ■ ■ and 
esj,,£s^_i, ■ • ■ are independent. On the other hand, we have some freedom to 
couple the innovations after time Sk- Here we only have to take care that both 
sequences (£t)tgz and (£j)(gz consist of independent random variables. A reason- 
ably good coupling is obtained by feeding both processes after time Sfc with one 
and the same sequence of innovations, that is, £^^+1 ~ ^st+i' ^ ■ ■ ■ ■ 

This gives, for t > Sfc, that 

oo 

~ Xi = ^ «*_,,+,(£,,-; - 4_;). (2.4) 

1=0 

Since ci(P-^'*i 1^=*= , P^^'i '^^O < IE(Ei=i l^t. " ^t'J l^^.o J we ob- 
tain, in conjunction with (2.3), the following assertion: 

Lemma 2.2. Let {Xt)ti=z cind (Xj')tgz be two versions of the autoregressive 
process as described above. //E|eo| < oo, then, for Sk < ti < . . . < ti, 

]g^/-pxt,,...,xt,|x,,^px^^,...,x;jx^ X < 2 I K, pi^-"" E\eo\. 

Lemma 2.1 and Lemma 2.2 imply the following weak dependence property. 

Corollary 2.1. Suppose that {Xt)tez *s o, stationary process satisfying the 
above conditions. Furthermore, let si < ■ ■ ■ < Sk < ti < ■ ■ ■ < ti be arbitrary 

and let g : R*^ > R and h : M} > K be measurable functions. If g is bounded 

and E|/i(Xtj , . . . , XtJ\ < oo, then 

\coY{g{Xs,,...,Xs,),hiXt,,...,Xt,))\ < ||.g||ooLip/iA'i 

where Ki^2 K, E|£o| • 

Now we define the autoregressive bootstrap. We assume that observations 
Xi_p, . . . , Xji are available. Let 0„ — {0n,i, • • ■ , dn.pY be any consistent estima- 

tor of 6' = (6*1, ... , Op)' , that is, 9n — > 0, as n —> oo. (The least squares and the 
Yule- Walker estimator are even y^-consistent.) Let Xt = (Xt-i, . . . , Xt-p)' be 
the vector of the p lagged observations at time t. We define residuals 



and re-center them as 
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Now we draw independent bootstrap innovations from the empirical distri- 
bution Pn given by the £t ■ A bootstrap version of the autoregressive process is 
now obtained as 

Xl = OnsXl^i + ••• + 0n,pXf_p + £*. (2.5) 

For simphcity, we assume that {X^)ti=z is in its stationary regime. (This will 
be justified by (i) of the next lemma.) Before we state weak dependence of the 
bootstrap process, we show that it inherits those properties from the initial 
process which were used for proving weak dependence. 

Lemma 2.3. Suppose that Eeq < oo and On — ^ are fulfilled. 

(i) With a probability tending to 1, [XDt^z can be written as a stationary 
causal linear process, 

oo 
k=Q 

where, for all e > 0, there exists a < oo such that, with ~ (1 + e)/p, 
V(\an,k\ < K.p': VfceN) — . 1. 

(it) E(ef |Xi_p,...,X„) ^ Eel 

Armed with the basic properties stated in Lemma 2.3, we can now easily 
derive properties of weak dependence of the bootstrap process just by imitating 
the proof for the initial process. In complete analogy to Lemma 2.2 above, we 
can state the following result. 

Lemma 2.4. Suppose that the initial process {Xt)t£i satisfies the above con- 
ditions and that the bootstrap process {X^)t£z is in its stationary regime. Let 
{X^ )tgz be another version of the bootstrap process, where X*^ = {X*^ , X*^_i, . . .) 
is (conditionally on Xi^p, . . . ,Xn) independent o/X*^ = {X*^, X*^_i, . . .). For 

any e > 0, let = (1 + e)/p and < oo be an appropriate constant. Then 
there exists a sequence of events f2„ such that ¥{Qn) — * 1 o-nd if fl„ occurs, 

n — ^oo 

then 

E(d(P'^*i---''^'*l^'sIP'^'*i'''''''^'*'''^'Ol^i-P'---'^«^ ^ 2?^, p*!-^" yie^. 

From Lemma 2.1 and Lemma 2.4 we can now derive the desired property of 
'(/'-weak dependence for the bootstrap process. 

Corollary 2.2. Suppose that the conditions of Lemma 2.4 are fulfilled. If the 
event fin occurs, then the following assertion is true: 

Let Si < ■ ■ ■ < Sk < ti < ■ ■ ■ < ti be arbitrary and let g ■.R'' — >]S. and h : 



p. Doukhan and M.H. Neumann/iji-weak dependence 153 

— > M be measurable functions. If g is bounded and K\h{Xf_^, . . . < oo, 

then 

|cov(g(X;,...,X:j,M^*,...,X*))| < \\g\\^UphK2lp*r^'', 

where K2 — 2 i^g -^/Eeq. 

Besides the useful property of weak dependence of the bootstrap process, 
asymptotic vahdity of a bootstrap approximation requires that the (muhivari- 
ate) stationary distributions of the bootstrap process converge to those of the 
initial process. Often, and in the case of the autoregressive bootstrap in par- 
ticular, one has no direct access to these stationary distributions. However, ac- 
cording to Lemma 4.2 in Neumann and Paparoditis (2007), convergence of the 

stationary distributions can be derived from an appropriate convergence of con- 

^ p 

ditional distributions. The latter, however, follows directly from 6'„ — > 9 and 
el — ^ £(. Therefore, consistency of the autoregressive bootstrap can be shown 
by simple arguments which were already used for proving weak dependence of 
the bootstrap; for details see Section 4.2 in N(nunann and Paparoditis (2007). 

Remark 3. Motivated by the desire to have some sort of mixing for a smoothed 
sieve bootstrap for linear processes, Bickel and Biihlmann (1999) considered a 
condition called i/-mixing which is similar to the notion of weak dependence in 
our Definition 1.1. Although strong mixing follows for linear processes from a 
result of Gorodetskii (1977), it seems to be unclear whether even a smoothed 
version of the bootstrap process has such a property. However, it was shown 
in Theorems 3.2 and 3.4 in Bickcl and Biililmami (1999) that it is i/-mixing 
with polynomial or exponential bounds on the corresponding coefficients to 
hold in probability. In the proofs of these theorems, however, they make use 
of the property of decaying strong mixing coefficients which holds at least for 
sufficiently large time lags; see in particular their Lemma 5.3. 

In contrast, the approach described here is fundamentally different. We intend 
to prove weak dependence for processes driven by innovations with a possibly 
discrete distribution and achieve this goal by exploiting a contraction property 
of the initial and the bootstrap process. 

Remark 4. Arguing in the same way as above we could also establish the prop- 
erty of '0-weak dependence for nonlinear autoregressive processes, 

Xt = m{Xt) + Et, te z, 

where (et)tgz is a sequence of independent and identically distributed innova- 
tions. If Lipm < 1, then we have obviously a contraction property being fulfilled 
which immediately yields ip-weak dependence. 

It is interesting to note that such a contraction property can still be proved 
if Lipm < 1 is not fulfilled. To this end, define the local Lipschitz modulus of 
continuity 

A(x) = sup '"^(y) 

y^x \y-x\ 
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and assume that 

p = supE [A(m(a;) + £o)] < 1- 

X 

Then 

d^^x,+^\Xt=x ^ pX.+,|X4=y-) < pk~i . ■\x~yl (2.6) 
which implies weak dependence by Lemma 2.1. 

3. Some examples of weakly dependent sequences 

Note first that sums of independent wealcly dependent processes admit the com- 
mon weak dependence property where dependence coefficients are the sums of 
the initial ones. We now provide a non-exhaustive list of weakly dependent se- 
quences with their weak dependence properties. Further examples may be found 
in Doukhan and Louhichi (1999). Let X = {Xt)t£Z be a stationary process. 

1. If this process is either a Gaussian process or an associated process and 
limt_,oo \cov{Xq, Xt)\ = 0, then it is a k- weakly dependent process such 
that K{r) = 0(sup\cov{Xo, Xt)\] ■ It is also K'-weakly dependent with 



^t>r 

K'{r)^0[J2\cov{Xo,Xt)\ 

^t>r 



2. ARMA{p, q) processes and more generally causal or non-causal linear pro- 
cesses: X = {Xt)tez are defined by the model equation 

oo 
A:— — oo 

where {ak)kGZ S and (Ct)tGZ is a sequence of independent and identi- 
cally distributed random variables with E^t = 0. If ak = 0{\k\~'^) with 

II > l/2,thcnXis an ry-weakly dependent process with ?/(?■) = 0( tttt)- 

In the general case of dependent innovations, properties of weak depen- 
dence are proved in Doukhan and Wintenberger (2007). 

3. GARCH{p, q) processes and more generally ARCH{oo) processes: X = 
{Xt)tez is a such that 

oo 

Xt = pf 6 with = &o + ^ bkXf_,. for fc e Z, 

fe=i 

with a sequence (bk)k depending on the initial parameters in the case of 
a GARCH(j),q) process and a sequence {(,t)t£Z of independent and iden- 
tically distributed innovations. Then, if Ed^ol™) < oo, with the condition 



oo 



of stationarity, ||^o||m ■ 2^ \ < 1, and if 
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• there exists C > and e]0, 1[ such that Vj e N, < 6_, < C • -' , 
then X is a ^-weakly dependent process with 0{r) = 0{e^'^^) and 
c > (this is the case of GARCH{p, q) processes). 

• there exists C > and v > 1 such that Vfc G N, < 6^ < C • 
k^", then X is a 0-weakly dependent process with 0{r) = ©(r^'^^^) 
(Doukhan, Teyssicre and Winant (2006) introduce vector valued 
LARCH(c!o) models including the previous ones). 

4. Causal bilinear processes were introduced by Giraitis and Surgailis (2002) 
and their dependence properties are proved in Doukhan, Madre and Rosen- 
baum (2(1117): 

(oo \ oo 

Oo + ^ akXt-k + Co + ^ CkXt-k, for fc e Z. 
k=l ) k=\ 

Assume that there exists m > 1 with ||^o||m, < oo and ||'Co||m- (X^fc^i kfc| + 
Er=ilcfcl) <1-Thcn, if: 

G N such that V/c > K, ak = Ck = 0, or, 
3H e]0, 1[ such that J2k Icfcl^"'' < 1 and Vfc G N, < au < ^J."" ' 
then X is a 6'-weakly dependent process with 9{r) = 0{e~'^^'), for 
some c > 0; 

• Vfc € N, Ck > 0, and 3i^i > 2 and 3^2 > such that ak = Oik^"^ ) and 
J2k Ckk^^^^ < oo, then AT is a 6'-weakly dependent process 

with 0(r) =0((-^)'^), d = max{ - (i^i - 1);- ^ ' J (see 

Doukhan, Teyssicre and Winant (200(i)). 

5. Non-causal LARCH(oo) processes X = {Xt)t£i satisfying 



a:* = 6 • Uo + XI ^kXt-k j , tel., 

where H^olloo < oo (bounded random variables) and {ak)kez is a sequence 
of real numbers such that A = ||^o||oo ■ X^jV^o l%l ^ ^ (stationarity con- 
dition). Assume that the sequence {ak)k£Z satisfies ak = 0{\k\^^^) with 

/X > 1, then X is an 77- weakly dependent process with 77 (r) = 0( ^__-^ ) (see 



Doukhan, Teyssicre and Winant (2006)). 

write as = V 



6. Causal and non-causal Volterra processes write as Xt = J^'^i ^t^'^ with 



Yt^"'' = ^n...at-n ■ ■ ■ 6-,, , for t e Z 



jl < j2 < • • • < jp 

ji, . . . , jp e z 
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oo 



Assume 

p=0 



E 



Il^ollm < OO, with m > 0, and 



ji < 32 < ■ ■ ■ < ip 
ji, . . . ,jp e Z 



that there exists po G N \ {0} such that aj-^^,,,j^ = for p > pq. If 



fljj ~ ^( ^^^■'^{b*! ^}) with /i > 0, then X is an 77- weakly depen- 



Finite order Volterra processes with dependent inputs are also considered 
in Doukhan and Wintcn1:)crgcr (2007): again, 77- weakly dependent innova- 
tions yield 77-weak dependence and A-weakly dependent innovation yields 
A- weak dependence of the process. 
7. Very general models are the causal or non-causal infinite memory processes 
X = (Xt)tgz such that 



Xt ^ F{Xt-uXt-2,...;^t), and Xt ^ F{Xs,s ^ t;^t), 
where the functions F defined either on RN\{o} ^ R or M^\{o> x M satisfy 

11^^(0; eo)l|m < 00, 



with a ~ ^ ^- Then, works in progress by Doukhan and Win- 

tenbcrgcr as well as Doukhan and Truquet, respectively, prove that a so- 
lution of the previous equations is stationary in L™ and either 0-weakly 
dependent or 77-weakly dependent with the following decay rate for the 
coefficients : 



This provides the same rates as those already mentioned for the cases of 
ARCH{oo) or LARCH{oo) models. 

4. Some probabilistic results 

In this section, we present results derived under weak dependence which are 
of interest in probability and statistics (see also Dcdcckc^r et al. (2007) for ref- 
erence). This collection clearly shows that this notion of weak dependence, al- 
though being more general than mixing, allows one to prove results very similar 
to those in the mixing case. 

4.1. Donsker invariance principle 

Wc consider a stationary, zero mean, and real valued sequence {Xt)tez such that 





H = E\Xor < 00, 



for a real number m > 2. 



(4.1) 
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We also set 



(4.2) 




W denotes standard Brownian motion and 



[nt] 

Wn{t) = ^yX^, fort e [0,1], n> 1. 



(4.3) 



We now present versions of the Donsker weak invariance principle under weak 
dependence assumptions. 

Theorem 4.1 (Donsker type results). Assume that the zero mean stationary 
process {Xt)t& satisfies (4-1)- Then cr^ > given by (4-2) is well defined and 
the Donsker invariance principle 

Wn{t) — >„— >oo cVF(t), in distribution in the Skorohod space D[[Q, 1]), 

holds if one of the following additional assumptions is fulfilled: 

• K-dependence. The process is K-weakly dependent and satisfies K{r) = 
0(r~'^) (as r ] oo) for some k> 2 + l/(m — 2). 

• K'-dependence. The process is k' -weakly dependent and satisfies k' [r) = 
0{r^'^) (as r ] oo) for some k > 1 + l/(m — 2). 

• A-dependence. The process is X-weakly dependent and satisfies A(r) = 
0{r-^) (as r ^ oo) for X> 4 + 2/{m-2). 

• ^-dependence. The process is 6-weakly dependent and satisfies 6{r) = 
©(r"^) (as r ^ oo) for > 1 + l/(m- 2). 

Remark 5. The result for K'-weak dependence is obtained in Bulinski and 
Shashkin (2005). Results under k- and A- weak dependences are proved in 
Doukhan and Wintenberger (2007); note that 77- weak dependence implies A- 
weak dependence and the Donsker principle then holds under the same decay 
rate for the coefficients. The result for 6'-weak dependence is due to Dedecker 
and Doukhan (2003). A few comments on these results are now in order: 

• The difference of the above conditions under k and k' assumptions is 
natural. The observed loss under K-dependence is explained by the fact 
that At'-weakly dependent sequences satisfy K'{r) > 2_^i^{s)- This simple 



bound directly follows from the definitions. 
• Actually, it is enough to assume the 0-weak dependence inequality for any 
positive integer u and only for v ~ 1. Hence, for any 1-bounded function 
g from R" to M and any 1-bounded Lipschitz function h from R to R 
with Lipschitz coefficient Lip(/i), it is enough to assume that the following 
inequality is fulfilled: |cov (^(Xij^ , . . . , X^^) , /i(Xi^_+i)) | < 9{i)Lip{h), for 
any u-tuple «i < ^2 < • • ■ < 
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4-2. Empirical process 

Let {Xt)t£Z a rcal-valucd stationary process. We use a quantile transform to 
obtain that the marginal distribution of this sequence is the uniform law on 
[0,1]. The empirical process of the sequence {Xt)tei at time n is defined as 
-^En{x) where 

n 

E„ix) = ^ (1I( 

fc=i 

Note that En — n [Fn — F) if F„ and F denote the empirical distribution func- 
tion and the marginal distribution function, respectively. We consider the fol- 
lowing convergence result in the Skohorod space I?([0, 1]) when the sample size n 
tends to infinity: 

-1-En{x) ^ B{x). 

Here (i?(a;))^g[o.i] is the dependent analogue of a Brownian bridge, that is B 
denotes a centered Gaussian process with covariance given by 

oo 

EB(x)B(y) = (^(^0 <x, Xk<y)~ P(Xo < x)P(Xfc < y)). (4.4) 

fc— — oo 

Note that for independent sequences with a marginal distribution function F, 
this turns into B{x) = B{x) for some standard Brownian bridge B; this justifies 
the name of generalized Brownian bridge. We have: 

Theorem 4.2. Suppose that the stationary sequence {Xt)t^z has a uniform 
marginal distribution and is rj-weakly dependent with ri{r) = 0{r~^^/'^~^), or 
K-weakly dependent K(r) = 0{r~^~'^), for some v > 0. Then the following 
empirical functional convergence holds true in the Skohorod space of real-valued 
cadldg functions on the unit interval, I?([0, 1]).' 

■^E^{x) B{x). 

Remark 6. Under strong mixing, the condition X^^o Q^('') < implies conver- 
gence of the finite-dimensional distributions. The empirical functional conver- 
gence holds if, in addition, for some a > 1, a{r) = 0{r~°') (see Rio (2000)). In an 
absolutely regular framework, Doukhan, Massart and Rio (1995) obtain the em- 
pirical functional convergence when, for some a > 2, /3(r) = C'(r~^(logr)~"). 
Shao and Yu (199G) and Shao (1995) obtain the empirical functional conver- 
gence theorem when the maximal correlation coefficients satisfy the condition 

oo 
n=0 

To prove the result, we introduce the following dependence condition for a 
stationary sequence (Xt)t<£Z' 



sup \cov{f{Xt,)fiXt,),f{Xt,)f{XtJ)\ < e(r). 



(4.5) 
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where !F — {x ^%<_x<t, for s, t G [0, 1]}, < ii < t2 < ^3 < ^4 and r = ^ — t2 
(in this case a weak dependence condition holds for a class of functions R" M. 
working only with the values m = 1 or 2). 

Proposition 4.1. Let (X„) be a stationary sequence such that (4-5) holds. 
Assume that there exists v > such that 

e{r) = 0(r-5/2--). 

Then the sequence of processes ( \ —=En{t): t G [0, 1] I ) is tight in the Sko- 

VlV^ ' )Jn>0 

horod space D{[0, 1]). 



4-3. Central limit theorems 



First central limit theorems for weakly dependent sequences were given by Corol- 
lary A in Doukhan and Louhichi (1999) and Theorem 1 in Coulon-Prieur and 
Doukhan (2000). While the former result is for sequences of stationary random 
variables, the latter one is tailor-made for triangular arrays of asymptotically 
sparse random variables as they appear with kernel density estimators. Using 
their notion of ;y-mixing Bickcl and Biililniann (1999) proved a CLT for linear 
processes of infinite order and their (smoothed) bootstrap counterparts. Below 
we state a central limit theorem for general triangular schemes of weakly depen- 
dent random variables. Note that the applicability of a central limit theorem to 
bootstrap processes requires some robustness in the parameters of the underly- 
ing process since these parameters have to be estimated when it comes to the 
bootstrap. A result for a triangular scheme is therefore appropriate since the 
involved random variables have themselves random properties. An interesting 
aspect of the following results is that no moment condition beyond Lindeberg's 
is required. The proof of the next theorem uses the variant of Rio of the classical 
Lindeberg method. 

Theorem 4.3. (Theorem 6.1 in Neumann and. Paparod.itis (2007)) Suppose 
that {Xn^k)k=i,....n, 71 G N, is a triangular scheme of (row-wise) stationary ran- 
dom variables with EX„_fc = and j, < C < oo. Furthermore, we assume 
that 

1 " 

-^EX2,,/(|X„,,.|/V^>e) ^ (4.7) 

n ^ — ^ n — >oc 

holds for all e > and that 

var(X„,i + • • • + A:„.„)/n — > e [0,oo). (4.8) 

n — 'OO 

For n > no, there exists a monotonously nonincreasing and summable sequence 
(0(r))reN such that, for all indices si < S2 < ■ ■ ■ < Su < Su + r = ti < t2, 
the following upper bounds for covariances hold true: for all measurable and 
quadratic integrahle functions g : M, 



|cov(r7(X„,,,,...,X„,,J,X„,tJ| < iyE52(X„,,,,...,X„,,J e{r), (4.9) 
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for all measurable and bounded functions g : M" — > K, 

|cov(.g(X„,,,,...,X„,,J,X„,t,X„,tJ| < MooOir), (4.10) 
where \\g\\oo = sup^gjj„ l/(a;)|. Then 

iXn,i + ■■■ + X„,„) ^ AA(0, a'). 



Remark 7. (i) Conditions (4.7) to (4.10) can be easily verified for autoregres- 
sive processes under the standard condition that the characteristic polyno- 
mial has no zero within the unit circle and if Eeq < oo, that is, finiteness 
of second moments actually suffices here; see Neumann and Paparoditis 
(2007) for details. 

(ii) If we have in the nth stage a two-sided sequence of random variables 
(Xn,k)kei, rather than {X„^k)k=i,....n only, then it can be easily seen that 
condition (4.8) follows from EXn,k = 0, EX^ ,^ < C < oo, (4.9), and 
J2kei,^'^^i^ri,o,Xn,k) ^-^^^cr'^ G [0,oo). 

(iii) Condition (4.9) is also related to Gordin (1969)'s condition under which 
central limit theorems are often proved for stationary processes. Such a 
theorem for a sequence of stationary ergodic random variables was proved 
by Hall and Hcyde (1980, pp. 136-138); see also Esseen and Janson (1985) 
for the correction of a detail. 



The following very simple multivariate central limit theorem, easily appli- 
cable to triangular schemes of weakly dependent random vectors, was derived 
in Bardet, Doukhan, Lang and Ragache (2007). In view of condition (4.11), it 
is applicable in cases where dependence between the observations declines as 
71 — > oo. This is a common situation in nonparametric curve estimation where 
the so-called "whitening-by-windowing" principle applies. 

Theorem 4.4. (Theorem 1 in Bardet. Doukhan, Lang and Ragache (2007)) 
Suppose that {Xn,k)keN, n € is a triangular scheme of zero mean random 
vectors with values in W^. Assume that there exists a positive definite matrix S 
such that 



E 



Cov(X„,fc) E 

1 



n — »oo 



and that, for each e > 0, 



k=l 



E(||X„,fe|l^J{||,Y„.,||>e}) 0, 



where \\ ■ \\ denotes the Euclidean norm. Furthermore, we assume the following 
condition is satisfied: 

n 

y |cov(e'*'(^"'i+-+-^'-'=-i),e**'-^-'=) — > 0. (4.11) 



k^2 
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Then, as n ^ oo, 

n 

fc=l 

Remark 8. One common point of these two results is the use of the classical 
Lindebcrg assumption. Note that this assumption is often verified by using a 
higher order moment condition. A main difference between the two results is 
that the first one yields direct applications to partial sums while the second one 
is more adapted to triangular arrays where the limit does not write as a sum. In 
this setting Doukhan and Wintenbcrgcr (2007) use Bernstein blocks to prove a 
CLT for partial sums. 

4.4- Probability and moment inequalities 

In this section we state inequalities of Bernstein and Rosenthal type. In the case 
of mixing, such inequalities can be easily derived by the well-known technique 
of replacing dependent blocks of random variables (separated by an appropriate 
time gap) by independent ones and then using the classical inequalities from the 
independent case; see for example Doukhan (1994) and Rio (2000). The notion 
of ip-weak dependence is particularly suitable for deriving upper estimates for 
the cumulants of sums of random variables which give rise to rather sharp 
inequalities of Bernstein and Rosenthal type which are analogous to those in 
the independent case. 

Based on a Rosenthal-type inequality, a first inequality of Bernstein-type was 
obtained by Doukhan and Louhichi (1999), however, with y/i instead of in 
the exponent. Dedcckcr and Prieur (2004) proved a Bennett inequality which 
can possibly be used to derive also a Bernstein inequality. A first Bernstein 
inequality with var(Xi + • • • -I- X„) in the asymptotically leading term of the 
denominator of the exponent has been derived in Kallabis and Neumann (2006), 
under a weak dependence condition tailor-made for causal processes with an 
exponential decay of the coefficients of weak dependence. The following result is 
a generalization which is also applicable to possibly non-causal processes with 
a not necessarily exponential decay of the coefficients of weak dependence. 

Theorem 4.5. (Theorem 1 in Doukhan and Neumann (2007)) Suppose that 
Xi, . . . , Xn are real-valued random variables with zero mean, defined on a prob- 
ability space (fi,^, P). Let ^E* : ^ N be one of the following functions: 

(a) *(m, w) = 2t;, 

(b) '^{u,v) = u + v, 

(c) ^{u, v) = uv, 

(d) ^{u,v) ~ a{u + v) + [1 — a)uv, for some a G {0,1). 

We assume that there exist constants K, M, Li, L2 < 00, fJ-,!^ > 0, and a 
nonincreasing sequence of real coefficients (p(n)),i>o such that, for all u-tuples 
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(si, . . . , Su) and all v-tuples (ti, . . . , i„) with 1 < Si < • • • < s„ < ii < • • • < 
ty < n the following inequalities are fulfilled: 

\cOY{X,,---Xs^,Xt,---Xt^)\ < A'2^/«+-2 {{u + vy.y ^{U,V) p{ti~ S^), 

(4.12) 

where 

oo 

^(s + l)V(s) < Li Ll {k\Y yk > 0, (4.13) 

s=0 

and 

E\Xt\'' < {kiy M'' Vfc>0. (4.14) 

Then, for all t > 0, 

r{Sn >t)< exp ( ) , (4.15) 



where An can be chosen as any number greater than or equal to and 



Bn^2{KVM)L, ((^ I^±±l)vi 



A first Rosenthal-type inequality for weakly dependent random variables was 
derived by Doukhan and Louhidh (1999) via direct expansions of the moments 
of even order. Unfortunately, the variance of the sum did not explicitly show 
up in their bound. Using cumulant bounds in conjunction with Leonov and 
Shiryaev's formula the following tighter moment inequality was obtained in 
Doukhan and Ncmnann (2007). 

Theorem 4.6. (Theorem 3 in Doukhan and Neumann (2007)) Suppose that 
Xi, . . . , Xn are real-valued random variables on a probability space (fi, P) with 
zero mean and let p be a positive integer. We assume that there exist constants 
K,M < oo, and a non-increasing sequence of real coefficients {p{n))n>o such 
that, for all u-tuples (.si,...,s„) and all v-tuples {ti, . . . ,tv) with 1 < si < 
■ ■ ■ < Su < ti < ■ ■ ■ < tv < n and u -\- v < p, condition (4-12) is fulfilled. 
Furthermore, we assume that 



l<M<p/2 
n-1 

where Bp.,, = {pl)^2P max {pl^^}, pk,n = Y{s + lf'^p{s) and 

s=0 



Then, with Z ^ N{Q,l) , 



^[Y^xA - al^ZP 



\k=\ 



p. Doukhan and M.H. Neumann/ili-weak dependence 



163 



To avoid any misinterpretation, we note that condition (4.12) with u + v < p 
and E|Xi|P~^ < M^*"^ only requires finiteness of moments of order p. This is 
in contrast to the conditions imposed in Theorem 4.5 where in particular all 
moments of the involved random variables have to be finite. 



5. Proofs 

Proof of Lemma 2.1. 

Let, for simplicity of notation, Sk = 0. Then 

cov(5(X,,,...,X,,),M^i,,...,XO) 

= E [g{X,,,. . . ,X,J (E(/i(Xt,, . . . \X,„.. . - m{Xt„. . .,Xu))] . 

Now wc obtain by Jensen's inequality for conditional expectations that 

|cov(g(X,,,...,X,J,M^,,,...,Xj)| 

< E[|g(X,,,...,X,J|.|E(/i(Xt,,...,XtJ |Xo) - EhiXt„...,Xt,)\] 

< E[|5(X,,,...,X,J|.|E(MXt,,...,Xt,) |Xo) - E(/i(x;,...,X,',) |X^)|] 



< Lip ft. E 



|.g(X,,,...,X,J|.EK]|Xi^-Xg 



The assertion follows now immediately. 
Proof of Lemma 2. 2. 

The assertion follows immediately from (2.3) and (2.4). 
Proof of Lemma 2. 3. 



□ 
□ 



(i) Let Cn.ii • ■ • J Cn,p be the roots of the characteristic polynomial 9n{z) = 

^ p . 
— > 9 we obtain 



1 — 9n,iz — • On,pzP of the bootstrap process. Since 6„ 

by Theorem 1.4 in Mardcn (1949) that 

min{|^„4|, . . . , |^„,p|} — > p = min{|^i|, . 
Therefore, we have, for any e > 0, that 

p(min{|C„,i|,...,|i,p|} > p/(l + e/2)) 



ICpI}. 



1. 



(5.1) 



Thus there exists a stationary solution to equation (2.5) which can also 
be written as a causal linear process. 



fe=0 



It follows from (5.1) that, for all e > 0, there exist some < oo such 
that, with = (1 + e)/p. 



\anM 



< G,p\ yk) — > 1. 
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(ii) To prove (ii), wc first split up 

n 1 1 2 

say. It follows from the strong law of large numbers that 

Tns ^ Ee^. 

Sinee {Xt)t& is ergodic wc obtain from Birkhoff (1931)'s ergodic theorem 
(see also Corollary 3.5.1 in Stout (1974)) that ^ X]"=i -^tX^ EXqXq. 
Using £t~ St ~ X[{9 — 9n) we therefore obtain that 



1 " 

Tn,2 — [On — XtX^{9n — 6) 

n ^ — ^ 



n 
t=i 



Finally, we conclude by the Cauchy-Schwarz inequality that T„.3 — > 0, 
which gives that 



1 " 



n ■'^ — ' 

t=i 



Since by the strong law of large numbers e. ~ (I/jt-) X]"=i and by 

Jensen's inequality (e^ — e.)^ < (l/?i) ~ ^t)^ '^^ also obtain that 



P 

e. — > 0. This implies that 



rj — ^ T7 ^ — ^ 

□ 



n — ' ~ n — ' 

t=i t=i 



Proof of inequality (2.6). 

We prove this result by a simple coupling argument. Let {Xt)tez and (X^)tt£z be 
two versions of the autoregressive process with Xt = x and X^ = y. Wc contruct 
a coupling simply by feeding both processes after time t with the same sequence 
of innovations et+i,St+2, ■ ■ that is. we have Xt+i+i = m{Xt+i) + St+i+i and 
^t+;+i = ™(-'^t+i) + £*+;+! (^ > 0). It follows from this construction that 

\Xt+k - -'^t+fel < A{Xt+k-i)\Xt+k-i - X!t+k-i\ 

< ... 

< A{Xt+k-i) ■ ■ ■ A{Xt+i)A{x)\x - y\. 

Therefore, we obtain that 



d 



< E ( A(Xt+fe_i) • • • AiXt+i)\Xt - x) ■ A{x) ■ \x - y\. 
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Using the Markov property we see that 

E(A(Xt+fc_i)---A(Xt+i)|Xt -x) 

= E [E(A(Xt+fc_i) I Xt+k-2) ■ ■ ■ E(A(Xt+i) I Xt = x)] 
< p'-\ 

which yields the assertion. □ 

Acknowledgment . We thank an Associate Editor and an anonymous referee for 
their helpful comments and suggestions. 

References 

Andrews, D. (1984). Probability inequalities for the sum of independent ran- 
dom variables. J. Appl. Probab. 21 930-934. 

Bardet, J. M., Doukhan, P., Lang G. and Ragache, N. (2007). Depen- 
dent Lindeberg central limit theorem and some applications. ESAIM Probab. 
Stat. 12 154-172. MR2374636 

BiCKEL, P. J. AND BUHLMANN, P. (1999). A ucw mixing notion and functional 
central limit theorems for a sieve bootstrap in time series. Bernoulli 5 413- 
446. MR1693612 

BiCKEL, P.J. AND Freedman, D. A. (1981). Some asymptotic theory for the 
bootstrap. Ann. Statist. 9 1196-1217. MR0630103 

Billingsley, p. (1968). Convergence of Probability Measures. New- York: Wi- 
ley. MR0233396 

BiRKHOFF, G. D. (1931). Proof of the ergodic theorem. Proc. Natl. Acad. Sci. 
USA 17 656-660. 

BOROVKOVA, S., Burton, R. and Dehling, H. (2001). Limit theorems for 
functionals of mixing processes with application to [/-statistics and dimension 
estimation. Trans. Amer. Math. Soc. 353 4261-4318. MR1851171 

Bradley, R. C. (2005). Basic properties of strong mixing conditions. A survey 
and some open questions. Probab. Surv. 2 107-144. MR2178042 

Bradley, R. C. (2007). Introduction to Strong Mixing Conditions (in 3 vol- 
umes). Kendrick Press, Heber City, Utah. 

Brockwell, p. J. AND DAVIS, R. A. (1991). Time Series: Theory and Meth- 
ods, 2nd edition. Springer, New York. MR1093459 

BULINSKI, A. AND Shashkin, A. (2005). Strong invariance principle for depen- 
dent multi-indexed random rariables. Doklady Mathematics 72 (1) 503-506. 

Coulon-Prieur, C. and Doukhan, P. (2000). A triangular central limit 
theorem under a new weak dependence condition. Statist. Probab. Lett. 47 
61-68. MR1745670 

Dedecker, J., Doukhan, P., Lang, G., Leon, J. R., Louhichi, S., 
Prieur, C. (2007). Weak Dependence: Models, Theory and Applications. Lec- 
ture Notes in Statistics 190, Springer- Verlag. MR2338725 

Dedecker, J. and Doukhan, P. (2003). A new covariance inequahty and 
applications. Stoch. Process. Appl. 106 (1) 63-80. MR1983043 



p. Doukhan and M.H. Neumann/ili-weak dependence 



166 



Dedecker, J. AND Prieur, C. (2004). Coupling for r-dcpcndcnt sequences 
and applications. J. Theor. Probab. 17 861-885. MR2105738 

Dedecker, J. and Prieur, C. (2005). New dependence coefficients. Examples 
and applications to statistics. Probab. Theory Related Fields 132 203-236. 
MR2199291 

Dedecker, J. and Rio, E. (2000). On the functional central limit theorem 
for stationary processes. Ann. Inst. H. Poincare Probab. Statist. 36 1-34. 
MRl 743095 

Dehling, H. and Philipp, W. (2002). Empirical process techniques for depen- 
dent data. In: Empirical Process Techniques for Dependent Data (H. Dehling, 
T. Mikosch and M. Sorensen, eds.), 3-113. Birkhiiuser, Boston. MR1958777 

DOBRUSHIN, R. L. (1970). Describing a system of random variables by condi- 
tional distributions. Tear. Veroyatn. Primen. 15 469-497 (in Russian). [En- 
glish translation: Theory Probab. Appl. 15, 458-486.] MR0298716 

Doukhan, P. (1994). Mixing: Properties and Examples. Lecture Notes in 
Statistics 85, Springer- Verlag. MR1312160 

Doukhan, P. (2002). Limit theorems for stationary sequences, in Long Range 
Dependence, Theory and Applications, editors P. Doukhan, G. Oppenheim 
and M. Taqqu, Birkhauser. 

Doukhan, P. and Louhichi, S. (1999). A new weak dependence condition 
and application to moment inequalities. Stoch. Process. Appl. 84 313-342. 
MR1719345 

Doukhan, P., Madre, H. and Rosenbaum, M. (2007). ARCH type bilinear 
weakly dependent models. Statistics 41 (1) 31-45. MR2303967 

Doukhan, P., Massart, P. and Rio, E. (1994). The functional central limit 
theorem for strongly mixing processes. Ann. Inst. H. Poincare Probab. Statist. 
30 (1) 63-82. MR1262892 

Doukhan, P., Massart, P. and Rio, E. (1995). Invariancc principle for the 
empirical measure of a weakly dependent process. Ann. Inst. H. Poincare 
Probab. Statist. 31 (2) 393-427. MR1324814 

Doukhan, P. and Neumann, M. H. (2007). ProbabiUty and moment inequal- 
ities for sums of weakly dependent random variables, with applications, Stoch. 
Process. Appl. 117 878-903. MR2330724 

Doukhan, P. and Portal, F. (1987). Principe d'invariance faiblc pom- 
la fonction de repartition empirique dans un cadre multidimensionnel et 
melangeant. Probab. Math. Statist. 8 (2) 117-132. MR0928125 

Doukhan, P., Teyssiere, G. and Winant, M. H. (2006). A LARCH(oo) 
vector valued process, in Dependence in Probability and Statistics, Lecture 
Notes in Statistics 187, Bcrtail, Doukhan & Soulier editors. Springer- Verlag. 
MR2269087 

Doukhan, P. and Wintenberger, O. (2007). An invariance principle for 
weakly dependent stationary general models. Probab. Math. Statist. 1 45-73. 
MR2353271 

Eberlein, E. and Taqqu, M. S. (eds.) (1986). Dependence in Probability and 

Statistics. Birkhauser, Boston. MR0899982 
Esseen, C.-G. and Janson, S. (1985). On moment conditions for normed 



p. Doukhan and M.H. Neumann/iji-weak dependence 



167 



sums of independent variables and martingale differences. Stock. Process. 
Appl. 19 173-182. MR0780729 

GiRAiTiS, L. AND SURGAILIS, D. (2002). ARCH-type bilinear models with 
double long memory. Stock. Process. Appl. 100 275-300. MR1919617 

GORDIN, M. I. (1969). The central limit theorem for stationary processes. Dokl. 
Akad. Nauk SSSR 188 739-741, (in Russian). [English translation: Soviet 
Math. Dokl. 10, 1174-1176.] MR0251785 

GORODETSKii, V. V. (1977). On the strong mixing property for linear se- 
quences. Teor. Veroyatn. Primen. 22 421-423, (in Russian). [English trans- 
lation: Theory Probab. Appl. 22, 411-413.] MR0438450 

Hall, P. and Heyde, C. C. (1980). Martingale Limit Theory and its Appli- 
cations, Academic Press, New York. MR0624435 

Ibragimov, I. A. (1962). Some limit theorems for stationary processes. Teor. 
Veroyatn. Primen. 7 361-392, (in Russian). [English translation: Theory 
Probab. Appl. 7, 349-382.] MR0148125 

Kallabis, R. S. and Neumann, M. H. (2006). An exponential inequality 
under weak dependence. Bernoulli 12 333-350. MR2218558 

Mallows, C. L. (1972). A note on asymptotic joint normality. Ann. Matk. 
Statist. 43 508-515. MR0298812 

Marden, M. (1949). The Geometry of the Zeros of a Polynomial in a Complex 
Variable. Mathematical Surveys Number III, Amer. Math. Soc, New York. 
MR0031114 

Merlevede, F. and Peligrad, M. (2002). On the coupling of dependent 
random variables and applications. In Empirical Process Techniques for De- 
pendent Data. pp. 171-193, Birkhauser. MR1958781 

Neumann, M. H. and Paparoditis, E. (2007). Goodness-of-fit tests for 
Markovian time series models: Central limit theory and bootstrap approx- 
imations. Bernoulli 14 14-46. 

Pitt, L. (1982). Positively correlated normal variables are associated. Ann. 
Probab. 10 496-499. MR0665603 

RiO, E. (1993). Covariance inequalities for strongly mixing processes. Ann. Inst. 
H. Poincare Probab. Statist. 29 (4) 587-597. MR1251142 

Rio, E. (1995). About the Lindeberg method for strongly mixing sequences. 
ESAIM Probab. Stat. 1 35-61. MR1382517 

Rio, E. (2000). Theorie asymptotique pour des processus aleatoires faiblement 
dependants. SMAI, Mathematiques et Applications 31, Springer. MR2117923 

Rosenblatt, M. (1956). A central limit theorem and a strong mixing condi- 
tion. Proc. Natl. Acad. Sci. USA 42 43-47. MRG074711 

Rosenblatt, M. (1980). Linear processes and bispectra. J. Appl. Probab. 17 
265-270. MR0557456 

Rosenblatt, M. (1985). Stationary Sequences and Random Fields. Birkhauser. 
MR0885090 

Shao, Q. M. (1988). Remark on the invariancc principle for p-mixing sequences 
of random variables. Ckinese Ann. Math. Ser. A 9 409-412. MR0996917 

Shao, Q. M. (1995). Maximal inequalities for partial sums of p-mixing se- 
quences. Ann. Probab. 23 948-965. MR1334179 



p. Doukhan and M.H. Neumann/ili-weak dependence 



168 



Shao, Q. M. and Yu, H. (1996). Weak convergence for weighted empirical 
processes of dependent sequences. Ann. Probab. 24 2052-2078. MR1415243 

Stout, W. (1974). Almost Sure Convergence. Academic Press, New York. 
MR0455094 

Wu, W. B. (2005). Nonlinear system theory: Another look at dependence. Proc. 
Natl. Acad. Sci. USA 102 14150-14154. MR2172215 



